Microsoft to Support Cross-Domain Sitemaps

LOS ANGELES — Microsoft, in collaboration with search competitors Google and Yahoo!, has announced an update to the Sitemaps Protocol, designed to increase usage through enhanced flexibility over where the sitemaps are hosted.

The update allows webmasters to host sitemap files on any domain, using a robots.txt file to indicate the location of the sitemap file and the domain it represents.

For example, MSN.com offers content across subdomains such as health.msn.com, travel.msn.com and moneycentral.msn.com, but is unable to host all of its sitemaps in one location, such as sitemaps.msn.com.

Until now the protocol did not support this scenario, each sitemap would have needed to be hosted directly under the domain it described," Fabrice Canel, program manager for Microsoft's Live Search Crawler, said. "This update now introduces support for this scenario, with the requirement that you simply include a reference to the sitemap in your robots.txt file."

Canel offered moneycentral.msn.com/robots.txt as an example, which could now include the following line; Sitemap: https://sitemaps.msn.com/index_moneycentral.msn.com.xml, adding that all URLs in the sitemap file must be within the same domain as the robots.txt file (e.g. moneycentral.msn.com/ in this example).

Multiple "Sitemap:" references are supported, although Microsoft recommends keeping robots.txt files under 1 MB in size and limiting individual sitemap files to under 10 MB, whether they are in XML, RSS or Text formats.

One feature that comes as a direct result of webmaster feedback is the ability to ping Live Search to notify it of updates to sitemaps.

In support of the changes to the Sitemap Protocol, Microsoft offers a Sitemap Forum for webmasters.

Related:  

Copyright © 2025 Adnet Media. All Rights Reserved. XBIZ is a trademark of Adnet Media.
Reproduction in whole or in part in any form or medium without express written permission is prohibited.

More News

British Documentary Spotlights XBIZ Amsterdam With Candid Conversations

British creator and host Josh Pieters traveled to XBIZ Amsterdam to film a documentary about the annual European adult industry conference.

XBIZ 2026 to Debut 'New Talent Go-See' Special Event

XBIZ 2026, North America’s premier adult industry conference, will debut a special event designed to help new talent jump-start their careers: the New Talent Go-See.

Penthouse Announces Digital Archive Launch

Penthouse Magazine has announced that it will launch a comprehensive digital archive in 2026.

Dreamcam Joins Pineapple Support as Supporter-Level Sponsor

Dreamcam has joined the ranks of over 70 adult businesses and organizations committing funds and resources to Pineapple Support.

AEBN Publishes Popular Searches by Country for August, September

AEBN has released the list of popular searches from its straight and gay theaters by country in August and September.

AV in Focus: A Guide to Unlocking Compliance With Clarity

The age verification era isn’t coming — it’s here. Laws are already on the books in numerous U.S. states, as well as in the U.K., France and beyond.

Canadian Privacy Commissioner Endorses National AV Bill

Philippe Dufresne, privacy commissioner of Canada, has voiced support for a bill that would impose fines of up to $500,000 on adult sites that do not implement age verification for Canadian viewers.

Ricky Johnson Launches 'Ricky's Resort' Through YourPaysitePartner

Ricky's Room studio honcho Ricky Johnson has launched his latest site, RickysResort.com, through YourPaysitePartner (YPP).

Industry Attorney Paul Cambria Retires After 50 Years of Practicing Law

After more than a half-century in practice, during which he provided the defense in some of the adult industry's most notable legal cases, attorney Paul Cambria has retired.

2026 XMA Nominations Party Set for Nov. 19 in Hollywood

The 2026 XMA nominations reveal party will take place at Keys on the Sunset Strip on Wednesday, Nov. 19, with red-carpet arrivals starting at 8 p.m.

Show More